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© Stroke syntax input device. 



© A pointing device-driven interface apparatus and 
method for enabling a user to enter data (in the form 
of options) into a computer system. User data files 
are maintained which indicate the relative frequency 
with which the user has entered sequences of op- 
tions. The sequences are of a predetermined length. 
The user data is consulted to predict the most likely 
options to be entered next by the user. These op- 
tions are presented to the user on a template. A 



stroke made by the user with the pointing device is 
then interpreted in light of the template and a syntax 
of strokes. An action associated with the interpreta- 
tion is then carried out. An example of the action is 
communicating a character to a software application, 
updating the sequence, and repeating the consulta- 
tion, presentation, interpretation and carrying out just 
described. 
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The present invention relates generally to a 
system and method for entering data into a com- 
puter system. More particularly, the present inven- 
tion relates to a system and method for entering 
data into a computer system which provides a 
spatially mapped input device and a point-addres- 
sable output device. 

Computers which accept commands through 
operations performed with a spatially mapped input 
device are becoming commonplace. Spatially 
mapped input devices more commonly known as 
pointing devices include but are not limited to 
"mice" and stylus-addressed digitizing tablets. The 
use of stylus addressed tablets is being driven by 
the general trend toward more natural user inter- 
faces utilizing handwriting and freehand drawing. 

Input devices used in these systems can take a 
variety of forms. The stylus used with the latter 
could be, for example, a pen-like writing instrument 
or the user's finger. In many applications, spatially 
mapped input devices used with "more natural" 
interfaces are superior to keyboards as a means for 
entering data. Such is the case, for instance, when 
a user of the computer has only one hand available 
for data entry. Other cases include (but are not 
limited to) those in which a keyboard would add 
too much bulk or weight to a data processing 
system designed to be highly portable or the case 
of a system designed for operation by a user who 
does not know how to (or is physically unable to) 
type. 

There have been two conventional approaches 
to translating data entered with a spatially mapped 
input device into machine-interpretable codes such 
as ASCII, "soft" keyboards, and character recogni- 
tion. 

The soft keyboard approach is typically imple- 
mented by displaying a dialogue box (i.e., a win- 
dow with controls that can be activated by 
"poking") which resembles a keyboard. The user 
may enter characters by pointing to, and poking, 
the desired key by operating the spatially mapped 
input device. Because character selection is explicit 
with this technique, data entry tends to be highly 
accurate. 

However, because the user must move the 
pointer (i.e., the displayed representation of the 
current position of the spatially mapped input) 
among a large number of widely separated "keys", 
entry is slow. The soft keyboard does not give the 
user the opportunity to position fingers for succes- 
sive strokes in the same time period that the cur- 
rent stroke is being entered, as does a real, phys- 
ical keyboard. Thus, this technique is not well 
suited for applications which require a substantial 
amount of data entry. 

Furthermore, displaying the soft keyboard re- 
quires a significant amount of space on a display 



device of a computer. On a highly portable com- 
puter, the output device may be quite small. Re- 
gardless of the size of the screen, many applica- 
tions operate best when able to display output on 
5 as large an area as possible and would be less 
usable if they had to share screen space with a 
soft keyboard. Thus, the first technique would be 
undesirable in such cases where screen space is at 
a premium. 

w In a second technique (used almost exclusively 

with stylus digitizers), the user operates the input 
device so that the stylus trace forms a likeness of 
each character which is to be entered. Typically, 
the likeness is digitized and compared to proto- 

75 types. A "best fit" algorithm is used to identify the 
desired character from among the prototypes. 

The second technique is intended to support a 
more "natural" interaction with a computer in which 
the common skill of handwriting largely replaces 

20 the skill of typing. For a portion of the population of 
computer users, this may be faster than typing. 
However, input speed is still limited by the require- 
ment that full characters be rendered accurately. If 
they are not drawn accurately, data entry is further 

25 slowed by the need to correct erroneous recogni- 
tion. Typically, the user continually monitors the 
interpreted characters and corrects those which do 
not match what he or she intended to enter. 

The laborious nature of the second technique 

30 makes it poorly suited to applications which require 
a substantial amount of data entry. Furthermore, 
since the user must form the likenesses of char- 
acters with a substantial amount of dynamic preci- 
sion in order for them to be recognized, the second 

35 technique would be difficult to carry out in a non- 
stationary environment such as in moving vehicle 
or on a hand-held, notebook-style computer. 

In addition to the two text entry techniques, 
pointing devices (i.e., spatially mapped input de- 

40 vices) are routinely used to cause predefined com- 
mands to be executed by computers. This is ac- 
complished either by representing a command as 
an icon or other graphic representation, or by pro- 
viding the command as a choice in a "menu". 

45 Neither of these input operations are well adapted 
to entry of text. If they were applied to the entry of 
text, they could be described as inconvenient 
forms of soft keyboards. 

Thus the conventional techniques each have 

so characteristics which limit their use in applications 
where input by a pointing device is desirable and 
where a substantial amount of text entry is re- 
quired. Therefore, what is needed is a pointing- 
device-driven interface which is adapted for such 

55 applications. 
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Disclosure of Invention 

The invention as claimed provides this in ad- 
vantageous manner. 

Accordingly, the present invention is directed 
toward a pointing-device-driven interface apparatus 
and method (called a stroke syntax input device) 
having a combination of the properties which facili- 
tate text entry. Such properties include the ability 
to quickly and accurately capture the user's input, 
an interface with which the user can interact with 
naturally, a display presentation which does not 
require an excessive amount of space, and which 
is more suitable than forming characters as a 
means to operate in non-stationary environments. 

The stroke syntax keyboard comprises two 
submodules. A data manager module acts on 
source text to prepare or update user data files. 
The source text comprises computer file repre- 
sentations of documents or collections of such re- 
presentations of documents. A presenter module 
utilizes the user data files to provide an interface 
environment in which the user is able to interact 
with the computer to create a coded character 
input stream. More particularly, the presenter mod- 
ule provides an interface environment which, in its 
most simplified form, determines by means of the 
user data files the most likely characters to be 
selected next by the user, formats the presentation 
of those characters, and interprets the user's point- 
ing device-entered strokes to cause characters to 
be selected or de-selected or to cause the pre- 
sentation to be refreshed. 

The modules combine to provide the user with 
a means to enter a character stream rapidly, ac- 
curately, and in a manner which requires minimal 
cognitive and physical burden on the part of the 
user. 

As with the soft keyboard, selection of units of 
data with the stroke syntax input device is explicit 
and does not require highly accurate operation of 
the pointing device. Therefore, data entry with the 
stroke syntax input device is highly accurate, even 
in unstable environments. 

Furthermore, the display format and syntax uti- 
lize natural hand-eye coordination skills acquired in 
the course of learning to handwrite. Handwriting 
requires the integration of a collection of compo- 
nent skills. The cognitive and physical effort of the 
stroke syntax input device of the present invention 
is minimized by utilizing the same skills. 

One such skill is that of moving a writing instru- 
ment, facilely, from an arbitrary location to the 
location of the point of visual focus. In cursive 
handwriting, this skill is observed when a person 
dots an "i" which occurs at a position distant from 
the last character of a word. As the last character 
of the word is completed, the visual focus of the 



writer moves to a point above the "i" and the 
writing instrument is moved to that point. In using 
the stroke syntax input device, this skill is exploited 
when the user focuses on a symbol or command to 

5 be selected and moves the stylus to the region in 
which it's presented. 

A second handwriting skill used by the stroke 
syntax input device is that of controlling the rela- 
tionship of a writing device to a line. In the perfor- 

70 mance of cursive handwriting, the writer will rou- 
tinely and accurately create ascenders and de- 
scenders on characters such as "b", "d", "g", and 
"j". The user will also move the stylus laterally 
without crossing a baseline to create characters 

15 such as "o" or "m". The stroke syntax input device 
exploits this skill by presenting regions marked 
with selectable characters or commands that can 
be reached by making stylus movements resem- 
bling those discussed above. 

20 The foregoing and other objects, features and 
advantages of the invention will be apparent from 
the following more particular description of pre- 
ferred embodiments of the invention, as illustrated 
in the accompanying drawing in which: 

25 Fig. 1 is a block diagram which shows the 
structure of the stroke syntax input device; 
Figs. 2A and 2B show a flow chart for the 
method of the stroke syntax input device of Fig. 
1; 

30 Fig. 3 shows an example of how the stroke 
syntax input device of Fig. 1 uses a task specific 
prediction table to predict and display char- 
acters most likely to be entered next; 
Figs. 4 and 5 shows an example of how predic- 

35 tion tables are constructed from and maintained 
with frequency tables; 

Fig. 6 shows the presentation of a first stroke 
board on a display device in a windowing envi- 
ronment; 

40 Fig. 7 shows a syntax chart for string entry with 
the first stroke board; 

Figs. 8A, 8B, 8C, 8D and 8E show a table of 
steps carried out by the user to enter a string on 
the first stroke board; 
45 Fig. 9 shows the presentation of a second stroke 
board on a display device in a windowing envi- 
ronment; 

Fig. 10 shows a syntax chart for string entry with 
the second stroke board; 
so Figs. 1 1 A and 1 1 B show a table of steps carried 
out by the user to enter a string on the second 
stroke board; 

Fig. 12 shows the presentation of a third stroke 
board on a display device in a windowing envi- 
55 ronment; 

Fig. 13 shows meaningful strokes which are in 
the syntax of the third stroke board overlaying 
an array of empty character boxes; 
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Fig. 14 shows a table of steps carried out by the 
user to enter a string on the third stroke board; 
and 

Fig. 15 is a flow chart for the method of the real 
time data collection buffer of Fig. 1. 

Detail Description for Carrying Out the Invention 

1 . Overview 

The present invention is directed toward a 
pointing-device-driven interface apparatus and 
method. Fig. 1 is a block diagram of the structure 
of the present invention. Specifically, Fig. 1 shows 
a stroke syntax input device 100 which essential 
comprises a data manager 106 and a presenter 
108. The data manager 106 and presenter 108 
interact with a user 120, a windowing system 122, 
a software application 124, and a spatially mapped 
input/output (I/O) system 112. The software ap- 
plication 124 could also be the operating system. 
The spatially mapped I/O system 112 comprises a 
display 156 and a digitizer 164. 

The data manager 106 comprises a real-time 
data collection buffer 132, a frequency-to-prediction 
batch processor 134, on-line frequency tables 142, 
on-line task specific prediction tables 144, and a 
memory-resident task specific prediction table 128. 
The presenter 108 comprises a prediction server 
126, a stroke board display system 116, and a 
stroke interpreter 1 1 4. 

The above-listed components of the data man- 
ager 106 and the presenter 108 (excluding the 
frequency tables 142 and the prediction tables 144) 
are modules which are executed by a computer 
104. It should be understood by those skilled in the 
art that although these modules could be imple- 
mented with "dedicated hardware", economy and 
availability dictate that a software implementation is 
to be preferred. It should also be understood that, 
to one skilled in the art, other partitions or function 
topologies can be implemented without departure 
from the spirit of the invention. 

The data manager 106 and presenter 108 mod- 
ules will be described briefly below and in more 
detail thereafter. 

The frequency tables 142 and the prediction 
tables 144 store what is collectively referred to as 
user data on a non-volatile on-line storage device 
130. 

The frequency tables 142 indicate the number 
of times particular sequences of options have oc- 
curred in an input text. In preferred embodiments, 
the sequences are made up of three options. The 
three-option sequences are called trigrams. The 
sequences could also be made up of, for example, 
two options or other fixed or variable numbers of 
options as permitted by computing resources or 



dictated by application requirements. In the em- 
bodiments described below, options are characters. 
However, options could also be, for example, op- 
erating system commands. 

5 The real time data collection buffer 132 moni- 

tors trigrams encountered as source text is en- 
tered. Generally, the input text is the text presently 
being entered by the user 120. Alternatively, a 
sample text 125 could be decomposed into trig- 

w rams and sent to the real time data collection 
buffer 132 (via a path 127) to create or enhance the 
frequency tables 142 and the prediction tables 144, 
or to improve prediction before the user 120 has 
entered enough data to construct meaningful fre- 

75 quency tables 142 and prediction tables 144. The 
real time data collection buffer 132 periodically 
empties itself and, in doing so, updates entities of 
one of the frequency tables 142. The frequency 
tables 142 contains integer representations of the 

20 number of times the user 1 20 has entered particu- 
lar trigrams. 

The prediction tables 144 indicate the relative 
frequency with which the user 120 has entered the 
trigrams. In cases where trigrams have never been 

25 observed by the system, entries for those trigrams 
will appear in alphabetical order following entries 
for trigrams which have appeared and can be or- 
dered by frequency. The frequency-to-prediction 
batch processor 134 periodically uses the data in 

30 the frequency tables 142 to update the prediction 
tables 144. 

To improve prediction, there are different fre- 
quency tables 142 and prediction tables 144 for 
different software applications. Accordingly, upon 

35 initialization a prediction table for a software ap- 
plication 124 in use is copied from the non-volatile 
on line storage device 130 into the computer 104. 
This prediction table is, thus, a memory-resident 
task specific prediction table 128. 

40 The prediction server 126 uses the task spe- 

cific prediction table 128 to predict the characters 
the user 120 will select next. The stroke board 
display system 116 generates a description of a 
template called a stroke board. The stroke board 

45 has the predicted characters as options for selec- 
tion by the user 120. The windowing system 122 
(of which the IBM OS/2 Presentation Manager may 
be considered a typical example) provides the dis- 
play management services needed to convert the 

so stroke board description into a screen presentation. 
The windowing system 122 performs this conver- 
sion and writes the presentation on the display 156. 
Finally, the stroke interpreter 1 1 4 interprets strokes 
made by the user 120 according to a syntax to 

55 cause characters to be selected or de-selected, or 
to cause the presentation to be refreshed. 

The word "stroke" used in this context refers 
to the user's actions with (for example) a stylus 
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which result in a data collection representing the 
spatial location at which the stylus was placed in 
contact with the surface of the digitizer 156, the 
path through which the stylus was drawn across 
the surface of the digitizer 156, and the location at 
which the stylus was lifted from the surface or 
segments thereof. Other definitions of stroke which 
are suitable to other pointing devices can be made 
which closely parallel this definition but are adapt- 
ed to that device. If a "mouse" were used, for 
example, the duration of the stroke would be from 
button-down to button-up or segments thereof rath- 
er than from stylus contact to stylus lift-off. 

Thus, the interaction between the user 120 and 
the present invention is essentially as follows. 
When the user 120 addresses the display 156, a 
stroke board is observed which is associated with 
some software application or with the operating 
system. The user 120 operates the stylus or other 
pointing device to create strokes. The digitizer 164 
translates each stroke into a data stream and sends 
the latter to the stroke interpreter 114 via a user 
input path 166. The presenter 108 then responds to 
the actions of the user 120 by interpreting the 
stroke. Finally, the result of the interpretation and 
the opportunity to enter a new stroke are presented 
to the user 120. As a result of the background 
activity of the frequency-to-prediction batch proces- 
sor 134, the predictions become more finely tuned 
to the vocabulary and style of the user 120 in a 
particular context. 

A design objective of the present invention is 
to make it easy for the user to discern characters 
he or she is likely to select next, comprehend how 
to select options on the presentation, and phys- 
ically move the pointing-device so as to select 
such options. In furtherance of improving predic- 
tion, preferred embodiments of the present inven- 
tion use different frequency and prediction tables 
for different applications. In furtherance of providing 
an effective interface, the stroke board and syntax 
of preferred embodiments varies according to the 
software application being used, the user's level of 
expertise, and the user's personal preference. 

2. Data Manager 

Each of the frequency tables 142 stores num- 
bers reflecting the number of times the user 120 
has entered each trigram while using a particular 
software application. Structurally, each of the fre- 
quency tables 142 is a one-dimensional array of 
entries. Each entry is made up of a trigram field 
and a frequency field. The frequency is indicative 
of the number of times the user 120 has entered 
the trigram. 

The real-time data collection buffer 132 com- 
prises an intelligent buffer which maintains the fre- 



quency tables 142. The buffer structure is similar 
to that of the frequency tables 142. The real-time 
data collection buffer 132 receives trigrams from 
the stroke interpreter 114 via the data path 148. 

5 When sufficiently filled, the real-time data collection 
buffer 132 updates the frequency tables 144 and 
empties itself. 

Fig. 15 is a flow chart which illustrates the 
details of the updating and clearing method. The 

w method merges the contents of the real time data 
collection buffer 132 with the contents of the appro- 
priate frequency table using two intermediate files 
called "old" and "new." These files are read from 
or written to at a file location corresponding, re- 

15 spectively, to the file pointers "old pointer" and 
"new pointer." 

In step 1508, the real-time data collection buff- 
er 132 writes the appropriate frequency table to the 
old file. In step 1510, the real-time data collection 

20 buffer 132 determines whether a buffer pointer 
used to track frequency table updating is pointing 
past the end of the real time data collection buffer 
142, indicating that all entries in the buffer have 
been processed. 

25 If all entries in the real time data collection 

buffer 142 have been processed, in step 1512 the 
portion of the old file succeeding the old pointer is 
written to the new file. Then, in step 1514 the new 
file is written to the frequency table being updated. 

30 In step 1516, the real time data collection buffer 
132 is "emptied." The real-time data collection 
buffer 132 then terminates its frequency table up- 
dating operation (see step 1517). 

If the buffer pointer was not pointing past the 

35 end of the buffer, then in step 1518 the frequency 
table updating function of the real-time data collec- 
tion buffer 132 determines whether the old pointer 
points past the end of the old file. If so, then all 
entries of the old file have been processed. Ac- 

40 cordingly, in step 1520 the portion of the buffer 
subsequent to the buffer pointer is written to the 
new file. Flow of control then goes to step 1514, 
which is explained above. 

If the old pointer did not point past the end of 

45 the old file, then in step 1522 the frequency table 
updating function of the real-time data collection 
buffer 132 reads the next entry of the buffer. In 
step 1524, it reads the next entry of the old file. In 
step 1526, the real-time data collection buffer 132 

so determines whether the trigram of the buffer entry 
precedes the same trigram of the old entry. If so, 
then in step 1528 the buffer entry is written to the 
new file. In step 1530, the old pointer is decremen- 
ted so that the same trigram of the old entry will be 

55 compared to the next trigram of the buffer. Flow of 
control then returns to step 1510, which is ex- 
plained above. 
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If in step 1526 the trigram of the buffer entry 
did not precede the trigram of the old entry, then in 
step 1536 the real-time data collection buffer 132 
determines whether the trigram of the buffer entry 
equals the trigram of the old entry. If not, then the 
trigram of the old entry must precede the trigram 
of the buffer entry. Accordingly, in step 1538 the 
old entry is written to the new file. Then, in step 
1 540 the buffer pointer is decremented so that the 
same trigram of the buffer entry will be compared 
to the next trigram of the old file. Flow of control 
then goes to step 1510, which is explained above. 

If the trigram of the buffer entry equals the 
trigram of the old entry, then in step 1542 that 
trigram and the sum of the frequency of the old 
entry and the frequency of the new entry are 
written to the new file. Flow of control then goes to 
step 1510, which is explained above. 

Clearly, in time, the numerical fields of the 
frequency tables 142 may contain large numbers. 
Overflow or wrap errors are avoided by having the 
frequency to batch processor 134 scale the fre- 
quency fields either periodically or when some 
trigram exceeds some threshold value. 

The rate at which the predictions adapt to the 
vocabulary and style of the user 120 will be af- 
fected by the method chosen for scaling. A pre- 
ferred method is carried out as follows. Scaling is 
triggered on a block of a prediction table when a 
sum written to the block in step 1542 of Fig. 15 
would exceed a predetermined threshold. A block 
of a prediction table is made up of all entries of the 
table which have a common first and second index. 
The threshold could be just less than the largest 
value representable by the frequency field. Fre- 
quencies could be scaled by simply dividing by 2. 
Note that division by 2 requires little computation 
time as it is performed with a shift right of one bit. 

Frequency fields of the frequency tables 142 
should be large enough to accommodate a broad 
range of values. Otherwise, many trigrams will be 
scaled to the same value, and prediction quality 
will deteriorate. In preferred embodiments, the fre- 
quency fields could have 16 bits of precision. Alter- 
natively, if space were a premium, they could have 
8 bits of precision. 

The prediction tables 144, store characters ac- 
cording to the frequency with which the user 120 
has selected them. If the computer 104 on which 
the stroke syntax input device 100 were imple- 
mented had adequate memory, each of the predic- 
tion tables 144 could store prediction data specific 
to one particular software application. Structurally, 
if only characters are to be predicted, and tables 
are not kept separately for predicting according to 
the position of a prediction in a word, then each of 
the prediction tables 144 is a 26x26x26 element 
array of characters. 



Entries of the prediction tables 144 are speci- 
fied by trigram indices. Generally, each trigram 
index is made up of three indices. The first two 
indices (called a preceding sequence) are the posi- 

5 tions of the first two characters of the desired 
trigram in an alphabetical ordering. Thus the index- 
ing character pair "aa" would provide the preced- 
ing sequence 1,1 while "bz" would provide the 
preceding sequence 2,26. Note that a portion of a 

10 prediction table indexed by a common preceding 
sequence is referred to as a prediction block. The 
third index (called the occurrence likelihood) is the 
position of any given character in order of declining 
likelihood. For example, the most likely character to 

15 follow "aa" would be stored at location 1,1,1 in the 
array, the second most likely at 1,1,2, etc., while 
the third most likely character to follow "bz" would 
be stored at 2,26,3. This storage structure allows 
easy retrieval of next character predictions if the 

20 two preceding characters are known. 

It is very likely that some trigrams will never be 
observed. In the event that a given trigram is 
unobserved, it still must be listed in the appropriate 
prediction table so that in the event the user 120 

25 wishes to enter a character which will cause the 
first instance of that trigram, the character will be 
presented. These as-yet-unobserved cases are 
handled by alphabetized entries in the array. For 
example, if the trigrams "bcq" and "bcm" were the 

30 only trigrams starting with "be" that were observed 
in the texts used to make the frequency tables, and 
"bcq" were the more frequent, then the predictions 
found at indices 2,3,1 through 2,3,6 would be 
"qmabed"; the predictions at indices 2,3,7 through 

35 2,7,12 would be "efghij"; and so on. 

Predictions of the stroke syntax input device 
100 could be improved by providing specialized 
prediction tables 144 adapted to the position of a 
character in a word. A preferred embodiment has 

40 four such prediction tables 144. 

A first specialized prediction table would be 
consulted to predict the first character of a word. 
The structure of the first specialized prediction 
table would be a one-dimensional 26 element array 

45 of characters. The trigram index of the first predic- 
tion table is the position of any given character in 
order of declining likelihood. For example, the three 
characters most likely to occur at the beginning of 
a word would be stored at locations 1, 2 and 3, 

so respectively. 

A second specialized prediction table would be 
consulted to predict the second character of a 
word. The structure of the second specialized pre- 
diction table would be a 26x26 element array of 

55 characters. The trigram index for the second pre- 
diction table is made up of two indices. The first 
index is the position of the first character of a word 
in an alphabetical ordering. The second index is 
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the position of any given character in order of 
declining likelihood of its occurrence as the second 
character of a word. For example, the three char- 
acters most likely to occur as the second character 
of a word starting with "t" would be stored at 
locations 20,1 ; 20,2; and 20,3, respectively. 

A third specialized prediction table would be 
consulted to predict the third character of a word. 
The structure and trigram indices of the third spe- 
cialized prediction table are the same as those for 
the general prediction tables 144 described above. 

A fourth specialized prediction table would be 
consulted to predict a character not occurring as 
the first, second, or third character of a word. The 
structure and trigram indices of the fourth predic- 
tion table are the same as those for the general 
prediction tables 144 described above. 

Implementation of specialized prediction tables 
for predictions beyond the third character of words 
would be obvious to one of skill in the art, and 
would not require a substantial amount of additional 
memory. 

Additionally, there could be a punctuation pre- 
diction table and a numeric prediction table asso- 
ciated with each software application. The structure 
and trigram indices for the punctuation and 
numeric prediction tables are the same as those for 
the first specialized prediction table. The punctua- 
tion prediction table contains punctuation marks 
and control characters such as "carriage return" 
and "tab". The numeric prediction table contains 
the numerals "0" through "9" and mathematical 
symbols such as " + " and 

The frequency tables 142 are written to at 
appropriate times by the real time data collection 
buffer 132. Accordingly, the structure of the fre- 
quency tables 142 facilitates indexing by trigram 
and frequent modification of the number of times 
trigrams have occurred. The prediction tables 144, 
on the other hand, are continually accessed by the 
prediction server 126. Accordingly, the data struc- 
ture of the prediction tables 144 facilitates deter- 
mining the character which has occurred with a 
specified relative frequency after a given two-char- 
acter sequence. The frequency to batch processor 
134 bridges the gap between the two data struc- 
tures. 

The frequency to batch processor 134 updates 
the prediction tables 144 using the data in the 
frequency tables 142 as follows. First, it reads a 
block of one of the frequency tables 142 from the 
non-volatile on-line storage device 130 (via a data 
path 176). The entries of the frequency table block 
are then sorted so that their frequency fields are in 
descending order. Associated with each of the en- 
tries is the third character of the trigram which the 
entry represents. The third characters of the trig- 
ram fields are written to the prediction block of the 



prediction table associated with the same software 
application and same first and second index as the 
frequency table block. The characters are written in 
the sorted order. In other words, they are written so 

5 that the characters in the prediction block are in 
order of declining likelihood. 

If a trigram has not occurred in the source text, 
there will be no entry for it in the frequency table 
block. Accordingly, the frequency-to-prediction 

10 batch processor 134 then determines the char- 
acters for which there were no entries in the fre- 
quency table block, sorts these characters so as to 
arrange them in alphabetical order, and writes them 
(in order) to the prediction block (via the path 178). 

15 Therefore, in the prediction block the alphabetized 
characters immediately follow the characters writ- 
ten from the frequency table block. 

3. Presenter Module 

20 

Fig. 2 shows a flow chart for the method of the 
presenter 108. The flow chart also illustrates the 
interaction of the modules of the stroke syntax 
input device 100. 

25 At start-up, the prediction table 144 corre- 

sponding to the software application 124 in use is 
copied (via a data path 1 40) to the memory of the 
computer 104. (See step 206.) The copy in the 
computer 104 is the task specific prediction table 

30 128. 

The stroke interpreter 114 then signals the 
prediction server 126 (via a data path 168) to 
perform an initial prediction. The stroke interpreter 
114 could generate such a signal by setting the 

35 preceding sequence of trigram indices to the al- 
phabetic positions of characters likely to precede 
the beginning of a sentence. (See step 208.) Such 
characters could be, for example, "period blank" or 
"blank blank". For an implementation of the 

40 present invention which displayed n characters on 
the stroke board, the stroke interpreter 114 could 
set the occurrence likelihoods of the trigram in- 
dices to the numbers 1 through n. A common value 
of n would be 6. 

45 Next, the prediction server 126 accesses the 

task specific prediction table 128 (via a data path 
170) with the trigram indices set by the stroke 
interpreter 114. The prediction server 126 thereby 
generates a list of characters ordered according to 

50 the probability that each will be entered next. (See 
step 210.) The prediction server 126 sends these 
characters (called predicted characters) through the 
stroke interpreter 114 to the stroke board display 
system 116 (via a data path 152). 

55 The stroke board display system 116 then gen- 

erates a description of a stroke board having the 
predicted characters as options for selection by the 
user 120. (See step 212.) The stroke board may 
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also have an option to indicate that the desired 
character is not presented as an option. In pre- 
ferred embodiments, options are presented in two- 
dimensional boxes. 

The windowing system 122 receives the stroke 
board description from the stroke board display 
system 116 (via a data path 154), converts the 
stroke board description into a screen presentation, 
and sends the screen presentation data to the 
display 156 via a data path 158. 

The user 120 then selects an option by forming 
an appropriate stroke on the digitizer 164. If the 
user 120 is using a stylus, appropriate strokes may 
include putting a stylus down in the box with the 
symbolic representation of the desired option or 
moving the stylus into the box. If the user 120 is 
using a mouse, appropriate strokes may include 
clicking on the box or moving the cursor into the 
box. The form of a selection stroke is dependent 
on the syntax used with a particular presentation of 
the stroke board. 

The digitizer 164 transmits the points compris- 
ing the strokes via a data path 166 to the stroke 
interpreter 114 which accumulates the points com- 
prising the stroke (see step 214). The stroke inter- 
preter 114 determines whether the accumulated 
stroke is meaningful. (See step 222.) A stroke 
which is not meaningful is either incomplete or 
violates the syntax currently in use. If the stroke is 
not meaningful, then the stroke continues to accu- 
mulate in the stroke interpreter 114. (See path 
224.) 

If the accumulator stroke is meaningful, then 
the stroke interpreter 114 interprets it. The stroke 
interpreter 114 performs the interpretation by ana- 
lyzing the accumulated stroke with respect to the 
syntax currently in use and the options currently 
displayed on the stroke board. 

If the accumulated stroke is interpreted to be a 
selection of one of the predicted characters or of 
the space character (see step 228), then the inter- 
preted character is processed as follows. The 
stroke interpreter 1 1 4 forms a trigram made up of 
the last three characters interpreted (see step 230), 
and communicates it to the real time data collec- 
tion buffer 132 via the path 148. The stroke inter- 
preter 114 then updates the trigram indices by 
setting the first indices to what were formerly the 
second indices and setting the second indices to 
the alphabetic position of the interpreted character. 
The occurrence likelihoods remain the numbers 1 
through n. (See step 232.) The stroke interpreter 
114 then sends the updated trigram indices to the 
prediction server 126 via the path 168. Next, the 
windowing system 122 receives the interpreted 
character from the stroke interpreter 114 (via the 
data path 152 to the stroke board display system 
116 and the data path 154 to the windowing sys- 



tem 122) and routes it to the software application 
124 (via the data path 176). (See step 234.) Alter- 
natively, the stroke interpreter 114 could send char- 
acters to the software application 124 through a 

5 more direct interface such as a keyboard queue of 
the software application 1 24. 

Upon receiving a character from the stroke 
interpreter 114, the software application 124 may 
use the windowing system 122 to display the char- 

w acter as part of some text. This text may also be a 
command. Flow of control then returns to step 210, 
(explained above) to consult the task specific pre- 
diction table 128 with the updated trigram indices. 
(See path 238.) 

75 If the accumulated stroke was interpreted as an 

indication that the desired character is not pre- 
sented on the stroke board (see step 240), then the 
stroke board must be refreshed so as to display 
the next set of n predicted characters. Accordingly, 

20 the stroke interpreter 114 adds n to each of the 
occurrence likelihoods of the trigram indices. (See 
step 248.) For example, if the stroke board had 
been displaying the six most likely characters to 
follow the sequence "th" when refreshed, the trig- 

25 ram indices would be updated from "20, 8, 1 " 
through "20, 8, 6" to "20, 8, 7" through "20, 8, 
12". Flow of control then returns to step 210. 

This refreshing process can continue until the 
character which is desired is displayed, even if this 

30 requires returning to display of the original set of 
six predictions after the complete set of character 
with the initial trigram indices have been shown 
once. In this way, even if the user 120 has errone- 
ously chosen to refresh the presentation despite 

35 the presence of the desired character, the char- 
acter will eventually be re-displayed. 

Alternatively, refresh options could be differen- 
tiated into more than one form (as will be shown in 
Figs. 6 through 14) so that the display may present 

40 the next most likely set of letters, the set of punc- 
tuation marks, the set of numbers, etc. 

If the stroke was interpreted as a request to 
delete the last character interpreted (see step 242), 
then processing is as follows. The stroke inter- 

45 prefer 114 updates the preceding sequences of the 
trigram indices by setting the second indices to the 
first indices and setting the first indices to the value 
of the first indices before the last character was 
selected. (See step 244.) For example, if the last 

so three characters selected were "t", "h" and "a", 
and the "a" were deleted, then the preceding se- 
quences would be updated from the alphabetic 
positions of "h" and "a" to the alphabetic positions 
of "t" and "h". The occurrence frequencies would 

55 remain 1 through n. The stroke interpreter 1 1 4 then 
sends the updated trigram indices to the prediction 
server 126. 
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The stroke interpreter 114 maintains a list of 
characters most recently interpreted. Accordingly, 
the stroke interpreter 114 then removes from this 
list the last character interpreted. (See Step 245.) 

The stroke interpreter 114 next sends a delete 
code to the windowing system 122 (via the path 
152 to the stroke board display system 116 and 
the path 154 to the windowing system 122). The 
windowing system 122 sends the delete code to 
the software application 124 (via the path 176). 
(See step 246.) Alternatively, the character could 
be deleted from the keyboard cue of the software 
application 124. 

The software application 1 24 may then use the 
windowing system 122 to remove the character 
from the display 156. Alternatively, if the software 
application 124 had interpreted the character as a 
command, then it could undo the command. Flow 
of control then returns to step 210, which is ex- 
plained above. (See path 238.) 

If the accumulated stroke was interpreted to 
request that the stroke board input device 100 be 
terminated (see step 250), then the processing is 
as follows. The stroke interpreter 114 signals the 
windowing system 122 (via the path 152 to the 
stroke board display system 116 and the path 154 
to the windowing system 122) to remove the stroke 
board from the display 156. (See step 252). 

The stroke interpreter 114 then informs the real 
time data collection buffer 132 (via the path 148) 
that it has interpreted a termination stroke. The real 
time data collection buffer 132 then empties itself 
by updating the frequency table 142 associated 
with the currently running software application 124 
(via the path 150). (See step 252.) Finally, the 
stroke syntax input device 100 satisfies any pro- 
gram termination requirements of the operating 
system. (See step 256.) Such requirements could 
include, for example, freeing any memory it has 
allocated. The stroke syntax input device 100 then 
ceases operation. (See step 257.) 

If the accumulated stroke was not interpreted 
to be a character selection, a refresh selection, a 
delete selection or a terminate selection, then the 
stroke did not conform to the syntax currently in 
use. (See step 258.) Flow of control then returns to 
step 214, which is explained above. This event 
indicates a software error has occurred. 

4. Table Maintenance 

The frequency-to-batch processor 134 main- 
tains the prediction tables 144 using data in the 
frequency tables 142. Figs. 4 and 5 show how this 
is done. Specifically, Fig. 4 shows an example of 
an initial frequency table block 410 and an initial 
prediction table block 412, and Fig. 5 shows a 
subsequent frequency table block 514 and a sub- 



sequent prediction table block 516. The table 
blocks shown are those associated with the se- 
quence "un". It should be understood that the "un" 
blocks are preceded by the "um" blocks and fol- 

5 lowed by the "uo" blocks and so on. Looking at the 
initial frequency table block 410, the number field 
of a "t" entry 420 is 3956, which is the number of 
times the sequence "unt" has occurred in the 
source text. The initial frequency table block 410 

m has no "z" entry. This indicates that the sequence 
"unz" has not occurred in the source text. 

The frequency-to-prediction batch processor 
134 generates the initial prediction table block 412 
from the initial frequency table block 410. The 

15 second entry 422 of the initial "un" prediction table 
block 412 is "t", which indicates that "t" has oc- 
curred in the source text second most frequently 
after "un". A twenty-sixth entry 424 of the initial 
prediction table block 412 is "z". (The twenty-sixth 

20 entry 424 is the last entry of the table.) No fre- 
quency data exists at this point in the example for 
the trigram "unz". Accordingly, the "z" is among 
the characters at the end of the initial prediction 
table block 412 which are placed in alphabetical 

25 rather than frequency order. 

Given the initial frequency table block 410 and 
the initial prediction table block 412, if the strings 
"count", "country" and "funzap" were to occur in 
the source text, then the trigrams in these words 

30 would be added to the real-time data collection 
buffer 132. At some time in the operation of the 
stroke syntax input device 100, the real time data 
collection buffer 132 generates the subsequent fre- 
quency table block 514 from the combination of the 

35 real-time data it contains and the initial frequency 
table block 410. 

The sequence "unt" occurs twice in the three 
words entered. Accordingly, the number field 418 
of the "t" entry 420 of the subsequent frequency 

40 table block 514 has increased by two to 3958. The 
sequence "unz" occurs once in the three words 
entered. Accordingly, a "z" entry 526 is created for 
the subsequent frequency table block 514 with a 
number field 528 of one. 

45 The process described above will accumulate 

models (expressed as trigram frequencies) of the 
user's vocabulary and usage for various software 
applications in the form of application-specific fre- 
quency tables. It is the job of the frequency-to- 

50 prediction batch processor 134 to convert these 
models into the prediction tables 144. 

The frequency-to-prediction batch processor 
134 is invoked on an available data and/or an 
available cycles basis. For example, it could be 

55 invoked nightly at a time when use of the computer 
104 is low, and more often if the user 120 was 
rapidly entering data. 
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The general operation of the frequency-to-pre- 
diction batch processor 134 is explained above. 
The frequency-to-prediction batch processor 134 in 
this example amends the initial prediction table 
block 412 to obtain the subsequent frequency table 
block 514. As with the initial prediction table block 
412, the second entry 432 of the subsequent pre- 
diction table block 516 is "t". This indicates that 
there is still exactly one character ("d") which has 
been encountered in the source text more often 
after "un" than "t". 

The character "z" is a twenty-first entry 532 of 
the subsequent prediction table block 516. The "z" 
was moved up from the twenty-sixth entry 424 
ahead of four characters ("j", "v", "x" and "y") 
which had still not been encountered after "un". 

5. Character Prediction 

Fig. 3 shows an example of how the stroke 
syntax input device 100 would carry out the steps 
212, 214 and 248 of Fig. 2. Specifically, Fig. 3 
shows sample text 310, a sample task specific 
prediction table block 312 having a plurality of 
entries, and the part of the display device 156 on 
which a sample prediction bar 314 is presented. 

In the example, the user 120 has just entered 
the string of characters, "coun". Step 212 is carried 
out as follows. The stroke interpreter 114 sends the 
trigram indices for "u, n, 1 " through "u, n, 6" to the 
prediction server 126. The prediction server 126 
returns the first six entries 316, 318, 320, 322, 324 
and 326, respectively, of the task specific predic- 
tion table block 312. The entries are the characters 
"d", "t", "i", "c", "e" and "a", respectively. Six 
characters are selected because this is both a 
small enough number of characters for the user 
120 to scan rapidly and is a large enough number 
for the probability of the selection containing the 
desired character to be high. 

The stroke board display system 116 carries 
out the step 214 as follows. The stroke board 
display system 116 presents the predicted char- 
acters in character boxes 330, 332, 334, 336, 338 
and 340 of the prediction bar 314. The most likely 
predictions are presented in the middle of the 
prediction bar 314, and the least likely predictions 
are presented on the left and right sides of it. The 
number and arrangement of the characters on the 
prediction bar 314 are chosen so as to maximize 
visibility and minimize stylus travel. It should be 
understood, however, that other arrangements may 
be chosen for that purpose without departing from 
the spirit of the invention. 

Specifically, the stroke board display system 
116 arranges the six characters on the prediction 
bar 314 as follows. The "d" in the first entry 316 of 
the task specific prediction table 128 is displayed 



in the character box 334 of the prediction bar 314. 
The "t" in the second entry 318 is displayed in the 
character box 336. The "i" in the third entry 320 is 
displayed in the character box 332. The "c" of the 

5 fourth entry 322 is displayed in the character box 
338. The "e" in the fifth entry 324 is displayed in 
the character box 330. The "a" in the sixth entry 
326 is displayed in the character box 340. 

Refreshing the prediction bar 314 involves 

ro steps 248, 212 and 214 and is carried out on the 
example as follows. The stroke interpreter 114 car- 
ries out the step 248 by adding 6 to each third 
index of the trigram indices to produce the trigram 
indices for "u, n, 7" through "u, n, 12". In carrying 

75 out step 212, the stroke interpreter 114 sends the 
trigram indices to the prediction server 126. The 
prediction server 126 returns the seventh through 
twelfth entries 348, 350, 352, 354, 356 and 358, 
respectively, of the task-specific prediction table 

20 segment 312. The entries are "s", "f", "n", "I", "p" 
and "g", respectively. The stroke board display 
system 116 carries out the step 214 by generating 
the prediction bar 314 with these characters in the 
character boxes 334, 336, 332, 338, 330 and 340, 

25 respectively. 

It is important to understand that while the 
foregoing material has been described in terms of 
using a single task-specific table for generating a 
fixed number of next-character predictions, it is 

30 within the scope of this invention to use both mul- 
tiple tables and multiple prediction methods. An 
example of use of multiple tables is described in 
detail above (in the section entitled "Data Man- 
ager"). 

35 Examples of other prediction methods could 

include language models that recognize when 
words have been formed so that word endings 
could be presented as options. A language model 
could also recognize the frequency with which 

40 whole words follow other words so that if a high 
probability word existed, the whole word could be 
presented as a selection along with letters or vary- 
ing length parts of words. Such prediction methods 
could be implemented by modifying the prediction 

45 tables 144 to include not only characters but also 
pointers to strings of characters. 

The number of predicted characters presented 
on the prediction bar 314 could be altered to reflect 
the certainty of a given prediction, as could the 

so area devoted to the character. In this form, the 
most likely character would occupy the largest 
display space. These two variations could simplify 
the cognitive task of finding the desired character. 
Implementation of these two variations requires 

55 that, in addition to storing the characters in order of 
decreasing likelihood of being selected, the predic- 
tion tables 144 would need to store the probabil- 
ities themselves. With such data, the prediction 
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server 126 and the stroke board display system 
116 could cooperate to alter the presentation on 
the prediction bar 314 as described above. Im- 
plementation of these two variations, however, is 
made at the cost of a substantial increase in the 
space required to store the prediction tables 144. 

6. First Stroke Board Display Format 

a. Overview 

Fig. 6 shows the presentation of a first stroke 
board display format on the display device 156 in a 
windowing environment. Presented on the display 
device 156 is an editor window 608 and a first 
stroke board 612. The editor window 608 shows 
entered text 613. 

The first stroke board 612 comprises a number 
of boxes, each of which is associated with an 
option specifying an action to be carried out. Spe- 
cifically, the stroke board 612 comprises the pre- 
diction bar 314 of Fig. 3, a space box 626, a 
refresh box 628, a delete box 630, a terminate box 
632, a numbers box 634, a punctuation box 635 
and a stroke space box 636. The character boxes 
330, 332, 334, 336, 338 and 340 of the prediction 
bar 314 contain the characters "o", "a", "t", "i " 
"s" and "b", respectively. 

b. Syntax 

Fig. 7 shows a syntax chart 700 for string entry 
with the first stroke board 612. Syntax charts are 
sometimes called "Railroad Diagrams" because 
the ordered list of "stations" a train riding on such 
a track could make are the expressions allowed 
and interpreted in that syntax. The user 120 of the 
first stroke board 612 of Fig. 6 makes a syntac- 
tically meaningful stroke by drawing the stylus 
through paths which are among the paths shown 
on the syntax diagram in Fig. 7. Upon completion 
of a syntactically meaningful stroke or sequence or 
strokes made by the user 120 on the first stroke 
board 612, some action or actions will be per- 
formed. 

As in cursive writing, it is possible to make 
many connected stokes to select long strings of 
characters. Unlike cursive handwriting, however, 
even spaces and deletions can be made without 
lifting the stylus. This could prove of substantial 
value in writing in physically precarious or agitated 
conditions. 

A sequence which is not syntactically meaning- 
ful causes no action. The syntax thus reduces the 
probability of erroneous strokes being accepted as 
selections by the user 120. A stroke from the 
stroke space 636 into a character box and back to 
the stroke space 636 will, because of the syntax, 



not accidentally cause two adjacent characters to 
be selected if the stylus should by accident pass 
through a second character box before reaching 
the stroke space 636. 

5 One action taken in response to a syntactically 

meaningful stroke is the selection of characters 
from the prediction bar 314 and the consequent 
refreshing of the prediction bar 314 from the task 
specific prediction table 128. Looking at Fig. 7, this 

w action is performed in response to the user 120 
sequentially entering the stroke space station 724, 
the character station 718 and the stroke space 
station 724. 

Alternatively, the user 120 could sequentially 
15 enter the pen down station 710, the character sta- 
tion 718 and the pen up station 728. However, the 
latter sequence does not lend itself to a cursive- 
writing style of stylus operation and thus will not be 
used frequently by an adept user. 
20 Note that sequentially entering the stroke 

space station 724, the character station 718, the 
character station 718 and the stroke space station 
724 is not syntactically meaningful. Thus, the syn- 
tax offers the user 120 protection from inadvertent 
25 mis-strokes by allowing the user 120 to negate the 
error by making that sequence of strokes meaning- 
less. 

A second action is the selection of a space. 
This action is performed in response to the user 

30 120 sequentially entering the stroke space station 
724, the space station 716 and the stroke space 
station 724. Alternatively, the user 120 could se- 
quentially enter the pen down station 710, the 
space station 716 and the pen up station 728. 

35 Note that no action is performed in response to 

the user 120 sequentially entering the stroke space 
station 724, the space station 716 and then moving 
the stylus into the region above or below the space 
box 626, as the latter sequence is syntactically 

40 meaningless. 

A third action is replacing the characters in the 
character boxes 330, 332, 334, 336, 338 and 340, 
with the six characters next most likely to be se- 
lected by the user 120. This action is performed in 

45 response to the user 120 sequentially entering the 
stroke space station 724, the refresh station 712 
and the stroke space station 724. Alternatively, the 
user 120 could sequentially enter the pen down 
station 710, the refresh station 712 and the pen up 

so station 728. 

Note that no action is performed in response to 
the user 120 sequentially entering the refresh sta- 
tion 712 and then moving the stylus into the region 
above or below the space box 626, as the latter 

55 sequence is syntactically meaningless. However, 
sequentially entering the refresh station 712, the 
punctuation station 720, the refresh station 712 and 
the stroke space station 724 is syntactically mean- 
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ingful. The latter sequence results in the prediction 
bar 330 showing punctuation marks. A similar se- 
quence can be used to obtain integers or math- 
ematical symbols. The punctuation marks, integers 
or mathematical symbols can then be selected in 
response to syntactically meaningful sequences as 
with characters. 

A fourth action is deleting the last character 
selected and causing the mostly likely prediction 
for the last state of the character entries to be 
restored to the prediction bar 314. This action is 
performed in response to the user 120 sequentially 
entering the stroke space station 724, the delete 
station 71 4 and the stroke space station 724. Alter- 
natively, the user 120 could sequentially enter the 
pen down station 710, the delete station 714 and 
the pen up station 728. 

A fifth action is terminating the input session 
and removing the first stroke board 612 from the 
display device 156. This action is performed in 
response to the user 120 sequentially entering the 
character station 718, the terminate station 726 and 
the pen up station 728. Note that no action is 
performed in response to the user 120 sequentially 
entering the character station 718, the terminate 
station 726 and the character station 718, as the 
latter sequence is not syntactically meaningful. 

A sixth action is replacing the characters in the 
character boxes 330, 332, 334, 336, 338 and 340 
with selections from a prediction table of numerals 
and mathematical symbols, and re-labeling the 
numbers box 634 of Fig. 6. This action is per- 
formed in response to the user 120 sequentially 
entering the refresh station 712, the numbers sta- 
tion 722 and the stroke space station 724. Alter- 
natively, the user 120 could sequentially enter the 
pen down station 710, the numbers station 722 and 
the pen up station 728. 

The prediction table used to generate the se- 
lections could be a simple ordered list. The num- 
bers box 634, marked "nums" prior to the sixth 
action, is re-labeled "char". Selecting the sixth 
action a second time (by again entering the stroke 
described above) causes the replacement of the 
numerals and mathematical symbols in the char- 
acter boxes 330, 332, 334, 336, 338 and 340 with 
predicted characters and the re-labeling of the 
numbers box 634 to "nums". 

A seventh action is replacing the characters in 
the character boxes 330, 332, 334, 336, 338 and 
340 with selections from a prediction table of punc- 
tuation marks and control entries (such as carriage 
return/line feed), and re-labeling the punctuation 
box 635 of Fig. 6. This action is performed in 
response to the user 120 sequentially entering the 
refresh station 712, the punctuation station 720 and 
the stroke space station 724. Alternatively, the user 
120 could sequentially enter the pen down station 



710, the punctuation station 720 and the pen up 
station 728. 

The prediction table used to generate the se- 
lections could be a simple ordered list. The punc- 

5 tuation box 635, marked "punc" prior to the sixth 
action, is re-labeled "char". Selecting the seventh 
action a second time (by again entering the se- 
quence described above) causes the replacement 
of the punctuation marks and control entries in the 

70 character boxes 330, 332, 334, 336, 338 and 340 
with predicted characters and the re-labeling of the 
punctuation box 634 to "punct". 

c. Sample String Entry 

75 

Fig. 8 shows a table of steps carried out by the 
user 120 to enter a string on the first stroke board 
612. Specifically, it shows how the user 120 would 
enter "count." after having entered "fair ". In this 

20 Figure, as well as in Figs. 11 and 14, strokes are 
represented as follows. A dotted line indicates the 
previous stroke made by the user 120. A solid line 
with an arrow indicates a current stroke made in 
the direction of the arrow. An "*" indicates a point 

25 at which the user 120 puts the stylus down or (for 

example) pushes the left mouse button. A 

indicates a point at which the user 120 lifts the 
stylus or (for example) releases the left mouse 
button. Also, in the tables of Figs. 8, 11 and 14, the 

30 entered text for a particular step is the text that is 
entered once the stroke shown on the stroke board 
of the same step has been interpreted. 

In step 1, the prediction bar 314 contains the 
characters most likely to be entered after a space. 

35 Specifically, the prediction bar 314 contains the 
characters "o", "a", "t", "i", "s" and "b" in the 
character boxes 330 through 340, respectively. The 
previous stroke was made from the stroke space 
box 636 to the space bar 626 and back to the 

40 stroke space box 636, thereby entering the space 
"character". The current stroke is made from the 
stroke space box 636 to the refresh box 628 and 
back to the stroke space box 636, thereby causing 
the prediction bar 314 to be refreshed. The entered 

45 text is the text the user 120 had already entered: 
"fair ". 

In step 2, the prediction bar 314 has been 
refreshed to contain the characters next most likely 
to be entered after a space. Specifically, the pre- 

50 diction bar 314 contains the characters "m", "p", 
"c", "w", "f" and "n" in the character boxes 330 
through 340, respectively. The previous stroke is 
the current stroke of step 1. The current stroke is 
made from the stroke space box 636 to the char- 

55 acter box 334 and back to the stroke space box 
636, thereby entering the "c" and causing the 
prediction bar 314 to be refreshed. The entered 
text is then "fair c". 

12 
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In step 3, the prediction bar 314 has been 
refreshed to contain the characters most likely to 
be entered after the sequence " c". Specifically, 
the prediction bar 314 contains the characters "I", 
"n", "o", "a", "u" and "e" in the character boxes 
330 through 340, respectively. The previous stroke 
is the current stroke of step 2. The current stroke is 
made from the stroke space box 636 to the char- 
acter box 334 and back to stroke space box 636, 
thereby entering the "o" and refreshing the predic- 
tion bar 314. The entered text is then "fair co". 

In step 4, the prediction bar 314 has been 
refreshed to contain the characters most likely to 
be entered after the sequence "co". Specifically, 
the prediction bar 314 contains the characters "I", 
"u", "m", "n", "r" and "d" in the character boxes 
330 through 340, respectively. The previous stroke 
is the current stroke of step 3. The current stroke is 
made from the stroke space box 636 to the char- 
acter box 330 and back to the stroke space box 
636, thereby entering the "I" and refreshing the 
prediction bar 314. The entered text is then "fair 
col". 

In step 5, the prediction bar 314 has been 
refreshed to contain the characters most likely to 
be entered after the sequence "ol". Specifically, 
the prediction bar 314 contains the characters "u", 
"v", "I", "i", "d" and "e" in the character boxes 
330 through 340, respectively. The previous stroke 
is the current stroke of step 4. The "I" in step 4 
was erroneously entered. The current stroke is 
therefore made from the stroke space box 636 to 
the delete box 630 and back to the stroke space 
box 636, thereby deleting the "I" and refreshing 
the prediction bar 314. The entered text is then 
"fair co". 

In step 6, the prediction bar 314 has been 
refreshed to again contain the characters most 
likely to be entered after the sequence "co". Spe- 
cifically, the prediction bar 314 contains the char- 
acters "I", "u", "m", "n", "r" and "d" in the char- 
acter boxes 330 through 340, respectively. The 
previous stroke is the current stroke of step 5. The 
current stroke is made from the stroke space box 
636 to the character box 332 and back to the 
stroke space box 636, thereby entering the "u" and 
refreshing the prediction bar 314. The entered text 
is then "fair cou". 

In step 7, the prediction bar 314 has been 
refreshed to contain the characters most likely to 
be entered after the sequence "ou". Specifically, 
the prediction bar 314 contains the characters "s", 
"n", "r", "I", "t" and "g" in the character boxes 
330 through 340, respectively. The previous stroke 
is the current stroke of step 6. The current stroke is 
made from the stroke space box 636 to the char- 
acter box 332 and back to the stroke space box 
636, thereby entering the "n" and refreshing the 



prediction bar 314. The entered text is then "fair 
coun". 

In step 8, the prediction bar 314 has been 
refreshed to contain the characters most likely to 

5 be entered after the sequence "un". Specifically, 
the prediction bar 314 contains the characters "e", 
"i", "d", "t", "c" and "a" in the character boxes 
330 through 340, respectively. The previous stroke 
is the current stroke of step 7. The current stroke is 

w made from the stroke space box 636 to the char- 
acter box 336 and back to the stroke space, there- 
by entering the "t" and refreshing the prediction 
bar 314. The entered text is then "fair count". 

In step 9, the prediction bar 314 has been 

15 refreshed to contain the characters most likely to 
be entered after the sequence "nt". Specifically, 
the prediction bar 314 contains the characters "s", 
"o", "e", "i", "y" and "r" in the character boxes 
330 through 340, respectively. The previous stroke 

20 is the current stroke of step 8. The current stroke is 
made from the stroke space box 636 through the 
refresh box 628 to the punctuation box 635 and 
back through the refresh box 628 to the stroke 
space box 636, thereby selecting the punctuation 

25 box 635. The entered text remains "fair count". 
The prediction bar 314 is refreshed to contain 
punctuation, and the punctuation box 635 is 
changed to read "char". 

In step 10, the prediction bar 314 has been 

30 refreshed to contain punctuation marks in response 
to the syntactically correct stroke through the punc- 
tuation box 635. Specifically, the prediction bar 314 
contains the marks ")", "?", ";" and "(" in 

the character boxes 330 through 340, respectively. 

35 The symbol in the punctuation box 635 has 
changed from "punct" to "char". This is to indicate 
that selecting the punctuation box 635 a second 
time will refresh the prediction bar 314 to again 
contain characters. The previous stroke is the cur- 

40 rent stroke of step 9. The current stroke is made 
from the stroke space box 636 through the char- 
acter box 334 to the terminate box 632. The stylus 
is lifted at a point below the terminate box 632, as 
indicated by a "° " 810. The current stroke has the 

45 effect of entering the "." and selecting the termi- 
nate option. The entered text is then "fair count.". 
In response to the selection of the terminate box 
632, the stroke board display system 116 causes 
the first stroke board 612 to be removed from the 

50 display device 156. 

7. Second Stroke Board Display Format 
a. Overview 

55 

Fig. 9 shows the presentation of a second 
stroke board display format on the display device 
156 in a windowing environment. Presented on the 
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display device 156 is the editor window 608 and a 
second stroke board 912. The editor window 608 
shows the entered text 613. 

The second stroke board 912 comprises a 
number of prediction bars 914-932 arranged one 
below the other on the display device 156. Each of 
the prediction bars 914-932 contains a large num- 
ber of characters. For example, each could contain 
the lower case alphabet. The characters are ar- 
ranged from the most likely to be selected at the 
left to the least likely at the right. 

The user 120 enters a string by making a 
predominantly downward stroke selecting appro- 
priate character boxes. New prediction bars are 
created and filled in response to each selection 
until selection of the space or terminate option. 
Selection of a space causes a prediction bar to be 
created and filled in at the top of the second stroke 
board 912. 

b. Syntax 

Fig. 10 shows a syntax chart 1000 for string 
entry with the second stroke board display format. 
The user 120 begins with a pen down action 1010. 
Essentially, the user 120 selects a character by 
making a stroke from above into the corresponding 
character box of one of the prediction bars (see 
action 1012). Exiting the character box through the 
bottom is interpreted as a request to display a new 
prediction bar (see action 1014). Exiting through 
the top is interpreted as a request to delete the last 
selected character (see action 1016). Lifting the 
pen in the character box is interpreted as a request 
to change the kind of prediction, for example, to 
numbers or to punctuation (see action 1018). A 
stroke which bypasses a prediction bar is inter- 
preted as a request to enter a "space", clear the 
prediction bar and begin again (see action 1020). A 
stroke made without entering a character box and 
without bypassing the prediction bar (i.e., directly 
from action 1010 to action 1018) is interpreted as a 
request to terminate. 

c. Sample String Entry 

Fig. 11 shows the stroke traced by the user 
120 to enter a string with the second stroke board 
912. Specifically, Fig. 11 shows how the user 120 
would enter the sequence "country." followed by 
two spaces. 

In step 1, the user enters "cound". The predic- 
tion bars 914-922 are presented on the second 
stroke board 912. The prediction bars 914-922 con- 
tain the predicted characters in the character 
boxes. A current stroke made from an "*" 1108 
through the prediction bars 914-922 is also shown. 



The prediction bar 914 contains the characters 
most likely to be entered at the beginning of a 
word. The current stroke is made downward 
through a character box 1110, which contains a 

5 "c". Accordingly, the first character entered is the 
"c" and the prediction bar 916 is created and filled 
with the characters most likely to be entered after 
the sequence " c". 

The current stroke continues downward 

w through a character box 1112, which contains an 
"o". Accordingly, the second character entered is 
the "o" and a next prediction bar 918 is created 
and filled with the characters most likely to be 
entered after the sequence "co". 

75 The current stroke continues downward 

through a character box 1114, which contains a 
"u". Accordingly, the third character entered is the 
"u" and a next prediction bar 920 is created and 
filled with the characters most likely to be entered 

20 after the sequence "ou". 

The current stroke continues downward 
through a character box 1116, which contains an 
"n". Accordingly, the fourth character entered is 
the "n" and the next prediction bar 922 is created 

25 and filled with the characters most likely to be 
entered after the sequence "un". 

The current stroke continues downward 
through a character box 1118, which contains an 
"d". Accordingly, the third character entered is the 

30 "d" and the next prediction bar 924 is created and 
filled with the characters most likely to be entered 
after the sequence "nd". The current stroke does 
not enter the prediction bar 924, as the "d" was 
entered erroneously. The entered text after the 

35 current stroke of step 1 is "cound". 

In step 2, the user deletes the "d". The predic- 
tion bars 914-922 are presented on the second 
stroke board 912. The prediction bars 914-920 and 
the portion of the current stroke made downward 

40 through them is unchanged from the first step. 
Therefore, in step 2 only the prediction bars 922 
and 926 and the portion of the current stroke made 
through them is shown. 

The prediction bar 922 still contains the char- 

45 acters most likely to be entered after the sequence 
"un". A previous stroke of step 2 is the current 
stroke of the first step. A current stroke of step 2 is 
made upward through a character box 1120 of the 
prediction bar 922. Accordingly, the last input char- 

50 acter (the "d") is deleted. Note that an upward 
stroke through any character box of the prediction 
bar 922 would have the same effect. 

The prediction bar 924 is then made blank, as 
the arrangement of its characters cannot be made 

55 until a character is entered from the prediction bar 
922. The text entered after the second step is 
"coun". 
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In step 3, the user 120 enters "try." followed 
by two spaces. The prediction bars 914-924 are 
presented on the second stroke board 912. The 
prediction bars 914-920 and the portion of the 
current stroke made through them is unchanged 
from the first step. Therefore, in step 3 only the 
prediction bars 922-926 and the portion of the 
current stroke made through them is shown. 

The prediction bar 922 still contains the char- 
acters most likely to be entered after the sequence 
"un". The current stroke is continued downward 
through a character box 1122, which contains a "t". 
Accordingly, the fifth character entered is the "t" 
and the prediction bar 924 is created and filled with 
the characters most likely to be entered after the 
sequence "nt". 

The current stroke is continued downward 
through a character box 1124, which contains an 
"r". Accordingly, the sixth character entered is the 
"r" and the prediction bar 926 is created and filled 
with the characters most likely to be entered after 
the sequence "tr". 

The current stroke is continued downward into 
a character box 1126, which contains a "y". Ac- 
cordingly, the seventh character entered is the "y". 

The user 120 then lifts the stylus from within 
the character box 1126, as indicated by a ""' 
1128. Doing so fills the next prediction bar 928 with 
punctuation marks, numbers and other non-alpha- 
betic characters. (Alternatively, doing so could ex- 
tend the prediction bar 926 to include non-alpha- 
betic characters.) 

The user 120 puts the stylus down at a point 
indicated by a "*" 1130 between the prediction 
bars 926 and 928. The user 120 continues the 
current stroke downward through a character box 
1131, which contains a Accordingly, the eighth 
character entered is the "." and the prediction bar 
930 is created containing the characters most likely 
to be entered after the sequence "y.". 

The user 120 then continues the stroke past 
the side of the prediction bar 930 to a point below 
the prediction bar. This is interpreted as a "space" 
character which is appended to the entered text to 
form "country. ". The stroke board is cleared, and 
a new prediction bar is displayed near the top of 
the second stroke board 912. 

In step 4, the user 120 puts the stylus down at 
a point above the prediction bar 930, as indicated 
by a "*" 1134. Finally, desiring a second space, the 
user 120 bypasses the prediction bar 932. Having 
entered an additional space, the user lifts the stylus 
from point below the prediction bar 932, as in- 
dicated by a 1136. Doing so causes the stroke 
board to be cleared and a new prediction bar to be 
displayed. The user 120 may now make a short 
stroke from a "*" 1138 to a "•" 1140 without 
crossing or bypassing the prediction bar 932 to 



request that the second stroke board 932 be termi- 
nated. 

8. Third Stroke Board Display Format 

5 

a. Overview 

Fig. 1 2 shows the presentation of a third stroke 
board display format on the display device 156 in a 

w windowing environment. Presented on the display 
device 156 is an editor window 608, which is typi- 
cal of any text editor, and a third stroke board 
1212. The editor window 608 shows the entered 
text 613. The third stroke board 1212 comprises 

15 the prediction bar 314 with six character boxes 
330, 332, 334, 336, 338 and 340, respectively and 
the space which surrounds the prediction bar 314. 

As with the first stroke board 312, the most 
likely predictions are displayed in the character 

20 boxes toward the center of the prediction bar 314, 
and the less likely predictions are displayed in the 
character boxes toward the left and right. An exten- 
sive stroke syntax enables the third stroke board 
1212 to provide data entry capabilities equivalent to 

25 those of the first and second stroke boards 612 
and 912, respectively, notwithstanding its limited 
amount of displayed material. 

b. Syntax 

30 

Fig. 13 shows a stroke diagram 1300 for the 
third stroke board 1212. The user 120 begins a 
stroke by putting the stylus down above the predic- 
tion bar 314, as indicated by a "*" 1310. If the 

35 stroke also ended above the bar as indicated by a 
" ° " 1311, the input session terminates and causes 
the stroke board display system 116 to terminate 
the third stroke board 1212 (i.e., remove it from the 
display device 156). 

40 Making a selection stroke downward into the 

character box 332 enters the character displayed in 
the box. 

Continuing the selection stroke into the adja- 
cent character box 330 and upward out of the latter 

45 refreshes the prediction bar 314. Similarly, continu- 
ing the stroke into an adjacent character box 334 
and upward out of the latter refreshes the predic- 
tion bar 314. 

Continuing the selection stroke upward back 

so out of the character box 332 deletes the entered 
character and refreshes the prediction bar 314. 
Continuing the selection stroke downward out of 
the character box 332 and then back up into the 
character box 332 and out the top of the latter 

55 likewise deletes the entered character and re- 
freshes the prediction bar 314. These two refresh 
strokes are provided to give the user 120 latitude in 
the amplitude of strokes. 
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Continuing the selection stroke downward out 
of the character box 332 and then lifting the stylus 
from below the prediction bar 314, as indicated by 
a " ° " 131 8, enters a space after the selected 
character and refreshes the prediction bar 314. 
Additional spaces can be made by making strokes 
below the prediction bar 314, that is, from an "*" 
1320 to a 1322. 

Lifting the stylus after making the selection 
stroke causes the prediction bar 314 to begin re- 
freshing from an alternate character set such as 
numbers or punctuation marks. When this is done, 
the selected character is deleted. 

c. Sample String Entry 

Fig. 14 shows a table of steps carried out by 
the user 120 to enter a string on the third stroke 
board 1212. Specifically, Fig. 14 shows how the 
user 120 would enter the word "count" followed by 
two spaces. 

In step 1, the prediction bar 314 contains the 
characters most likely to be entered after a space. 
Specifically, the prediction bar 314 has the char- 
acters "o", "a", "t", "i", "s" and "b" in the char- 
acter boxes 330-340, respectively. The user 120 
puts the stylus down above the prediction bar 314, 
as indicated by an "*" 1410. The current stroke is 
made downward through the character box 334, 
which contains a "t", and back upward through the 
same box. Such a stroke selects the "t", deletes 
the t, and refreshes the prediction bar 314. There is 
no text entered after step 1 . 

In step 2, the prediction bar 314 has been 
refreshed to contain the characters next most likely 
to be entered after a space. Specifically, the pre- 
diction bar 314 has the characters "m", "p", "c", 
"w", "f" and "n" in the character boxes 330-340, 
respectively. The previous stroke of step 2 is the 
current stroke of step 1 . The current stroke of step 
2 is made downward into the character box 334 
and upward out of the character box 336, thereby 
entering the "c" and refreshing the prediction bar 
314. The text entered after step 2 is "c". 

In step 3, the prediction bar 314 contains the 
characters most likely to be entered after the se- 
quence " c". Specifically, the prediction bar 314 
has the characters "I", "h", "o", "r", "u" and "e" in 
the character boxes 330-340, respectively. The 
previous stroke of step 3 is the current stroke of 
step 2. The current stroke of step 3 is made 
downward into the character box 334 and upward 
out of the character box 336, thereby entering the 
"o" and refreshing the prediction bar 314. The text 
entered after step 3 is "co". 

In step 4, the prediction bar 314 contains the 
characters most likely to be entered after the se- 
quence "co". Specifically, the prediction bar 314 



has the characters "I", "u", "m", "n", "r" and "d" 
in the character boxes 330-340, respectively. The 
previous stroke of step 4 is the current stroke of 
step 3. The current stroke of step 4 is made 

5 downward into the character box 332 and upward 
out of the character box 334 thereby entering the 
"u" and refreshing the prediction bar 314. The text 
entered after step 3 is "cou". 

In step 5, the prediction bar 314 contains the 

w characters most likely to be entered after the se- 
quence "ou". Specifically, the prediction bar 314 
has the characters "s", "n", "r", "I", "t" and "g" in 
the character boxes 330-340, respectively. The 
previous stroke of step 5 is the current stroke of 

75 step 4. The current stroke of step 5 is made 
downward into the character box 332 and upward 
out of the character box 334 thereby entering the 
"n" and refreshing the prediction bar 314. The text 
entered after step 5 is "coun". 

20 In step 6, the prediction bar 314 contains the 

characters most likely to be entered after the se- 
quence "un". Specifically, the prediction bar 314 
has the characters "e", "i", "d", "t", "c" and "a" in 
the character boxes 330-340, respectively. The 

25 previous stroke of step 6 is the current stroke of 
step 5. The current stroke of step 6 is made 
downward through the character box 336, thereby 
entering the "t" and refreshing the prediction bar 
314. The text entered after step 6 is "count". 

30 In step 7, the prediction bar 314 contains the 

characters most likely to be entered after the se- 
quence "nt" Specifically, the prediction bar 314 
has the characters "a", "e", "y", "s", "i" and "r" in 
the character boxes 330-340, respectively. The 

35 previous stroke of step 7 is the current stroke of 
step 6. The user 120 lifts the stylus from a point 
below the prediction bar 314 indicated by a "°" 
1412, thereby entering a space. The text entered 
after step 7 is "count" followed by a space. 

40 In step 8, the prediction bar 314 has the char- 

acters "o", "a", "t", "i", "s" and "b" in the char- 
acter boxes 330-340, respectively. The user 120 
puts the stylus down at a point below the prediction 
bar 314, as indicated by a "*" 1414. The user 120 

45 then lifts the stylus from another point below the 
prediction bar 314, as indicated by a "•" 1416. 
Doing so enters a second space. 

In step 9, the prediction bar 314 has the char- 
acters "o", "a", "t", "i", "s" and "b" in the char- 

50 acter boxes 330-340, respectively. The user 120 
puts the stylus down at a point above the predic- 
tion bar 314, as indicated by a "*" 1418. The user 
120 then lifts the stylus from another point above 
the prediction bar, as indicated by a 1420. 

55 Doing so terminates the input session and invokes 
the stroke board display system 116 to remove the 
third stroke board from the display device 156. The 
text displayed after step 9 remains "count" fol- 

16 
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lowed by two spaces. 

While the invention has been particularly 
shown and described with reference to preferred 
embodiments thereof, it will be understood by 
those skilled in the art that various changes in form 
and details may be made therein without departing 
from the spirit and scope of the invention. 

Claims 

1. A method operating on a computer system 
which interprets a stroke made by a user with 
a spatially mapped input device so as to en- 
able the user to cause an action associated 
with the option to be carried out, said method 
comprising the steps of: 

(1) consulting user data with an index to 
select a predicted option, said user data 
indicating the frequency with which each of 
a plurality of input sequences has occurred, 
wherein each of said input sequences com- 
prises a subsequent option which occurred 
immediately after a preceding sequence; 

(2) generating a template having a stroke 
space region through which strokes may be 
made and a predicted option region repre- 
sentative of said predicted option; 

(3) displaying said template on a display; 

(4) accumulating the stroke made by the 
user; 

(5) interpreting the stroke in light of a syntax 
and said template and to determine the 
option indicated by the stroke; and 

(6) causing the action associated with the 
option to be carried out. 

2. The method of claim 1 , wherein step (6) com- 
prises the steps of; 

(7) adding a value to an occurrence likeli- 
hood of said index; and 

(8) repeating steps (1) - (6); 

or wherein step (6) comprises the steps of: 

(9) communicating a character to a software 
application; 

(10) updating said user data to reflect the 
occurrence of one said input sequence 
which comprises characters most recently 
communicated in step (9); 

(11) updating an indexing preceding se- 
quence of said index so that it comprises 
characters most recently communicated in 
step (9); and 

(12) repeating steps (1) - (6), 

or wherein step (6) comprises the steps of: 

(13) communicating a command to an op- 
erating system; 

(14) updating said user data to reflect the 
occurrence of one said input sequence 



which comprises commands most recently 
communicated in step (13); 

(15) updating an indexing preceding se- 
quence of said index so that it comprises 

5 commands most recently communicated in 

step (13); and 

(16) repeating steps (1) - (6). 

3. The method of claim 1 or 2, further comprising 
w the step of updating said user data to reflect 

the occurrence of one said input sequence 
which occurs in a sample text. 

4. The method of claim 1 , wherein step (6) com- 
75 prises the steps of: 

(17) detecting the occurrence of one said 
input sequence; 

(18) if there is a buffer entry of a buffer 
having said detected interpreted input se- 

20 quence as a first input sequence field, then 

incrementing a first occurrence likelihood 
field of said buffer entry; 

(19) if there is no buffer entry having said 
detected input sequence as said first input 

25 sequence field, then: 

(i) creating a new buffer entry; 

(ii) setting said first sequence field of 
said new buffer entry to said detected 
input sequence; and 

30 (iii) setting said first occurrence likelihood 

field of said new buffer entry to one; and 

(20) repeating steps (17) - (19) for each said 
input sequence which has occurred, 

and/or wherein step (6) preferably further com- 
as prises the steps of: 

(21) reading one said buffer entry from said 
buffer; 

(22) determining whether a second input 
sequence field of a frequency entry of a 

40 frequency table equals said first input se- 

quence field of said buffer entry read; 

(23) if the determination of step (22) is 
negative, then writing said buffer entry read 
to said frequency table so as to maintain an 

45 ordering of frequency entries according to 

said second input sequence fields; 

(24) if the determination of step (2s) is posi- 
tive, then adding said first occurrence likeli- 
hood field of said buffer entry read to a 

so second occurrence likelihood field of said 

frequency entry having said second input 
sequence field equal to said first input se- 
quence field; and 

(25) repeating steps (21 ) - (24) for each said 
55 buffer entry in said buffer, 

and/or wherein step (6) preferably further com- 
prises the steps of: 
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(26) generating from said frequency table a 
frequency table block of block frequency 
entries, each having a common preceding 
sequence as said preceding sequence of 
said second input sequence field; 5 

(27) arranging said block frequency entries 
in descending order by said second occur- 
rence likelihood fields; 

(28) writing said subsequent options of said 
second input sequence fields of said block 10 
frequency entries to a prediction block of a 
prediction table; 

(29) determining additional subsequent op- 
tions not written in step (28); 

(30) arranging said additional subsequent 15 
options in a sorted order; and 

(31) writing said additional subsequent op- 
tions to said prediction block; 

(32) repeating steps (26) - (31) for each 
frequency table block in said frequency ta- 20 
ble. 

The method of claim 4, further comprising the 
step of scaling the values of said second oc- 
currence likelihood fields. 25 

The method of claim 4 or 5, wherein step (26) 
further comprises the step of selecting said 
prediction table from a plurality of prediction 
tables, based on a software application cur- 30 
rently in use or based on the length of said 
preceding sequence. 

The method of claim 1 , or one of the claims 2 
to 6, wherein step (2) comprises the step of 35 
generating a template having said stroke space 
region and a plurality of said predicted option 
regions for a plurality of predicted options, 
or wherein step (2) comprises the step of gen- 
erating said template having said stroke space 40 
region, a plurality of predicted option regions 
for a plurality of predicted options, a space 
region associated with the option of selecting a 
space character, a delete region associated 
with the deletion of the last option selected, 45 
and a refresh region associated with the option 
of refreshing said predicted option regions, 
or wherein step (2) comprises the step of de- 
termining the number of predicted options to 
include on said template so as to maintain an 50 
approximately constant probability that said 
template will have said predicted option which 
the user will next desire. 

An apparatus operating on a computer system 55 
which interprets a stroke made by a user with 
a spatially mapped input device so as to en- 
able the user to cause an action associated 



with the option to be carried out, comprising: 

(i) a spatially mapped input/output system 
comprising: 

(1) a display; and 

(2) a digitizer which accumulates the 
stroke made by the user and generates a 
stroke data stream; 

(ii) a data management module which main- 
tains a user data data structure indicative of 
the frequency with which each of a plurality 
of interpreted input sequences has oc- 
curred, wherein each of said interpreted in- 
put sequences comprises a subsequent op- 
tion which occurred immediately after a pre- 
ceding sequence; and 

(iii) a presentation module comprising: 

(1) a prediction server which consults 
said user data data structure with an 
index to select a predicted option; 

(2) a stroke board display system which 
generates a description of a template for 
presentation on said display, said tem- 
plate having a stroke space region 
through which strokes may be made and 
a predicted option region representative 
of said predicted option; and 

(3) a stroke interpreter which: 

(a) receives said data stroke stream 
from said digitizer; 

(b) interprets said stroke stream in 
light of a syntax and said template to 
determine the option indicated by the 
stroke; and 

(c) causes the action associated with 
the option to be carried out. 

9. The apparatus of claim 8, wherein said stroke 
interpreter causes the action to be carried out 
by adding a value to an occurrence likelihood 
of said index and invoking said presentation 
module, 

or wherein said stroke interpreter causes the 
action to be carried out by: 

(i) communicating a character to a software 
application; 

(ii) communicating to said data management 
module one said input sequence comprising 
characters it has most recently communi- 
cated to said software application; 

(iii) communicating to said prediction mod- 
ule an index comprising an occurrence like- 
lihood and an indexing preceding sequence 
made up of characters it has most recently 
communicated to said software application; 
and 

(iv) invoking said presentation module, 

or wherein said stroke interpreter causes the 
action to be carried out by: 
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(i) communicating a command to an operat- 
ing system; 

(ii) communicating to said data management 
module one said input sequence comprising 
commands it has most recently commu- 
nicated to said software application; 

(iii) communicating to said prediction mod- 
ule an index comprising an occurrence like- 
lihood and an indexing preceding sequence 
made up of commands it has most recently 
communicated to said operating system; 
and 

(iv) invoking said presentation module. 

10. The apparatus of claim 8 or 9, further compris- 
ing a source text which is decomposed into a 
plurality of said input sequences and commu- 
nicated to said data management module. 

11. The apparatus of claim 8, 9 or 10, wherein said 
user data data structure comprises a real time 
data collection module which receives said in- 
put sequences communicated to said data 
management module and updates a buffer of 
buffer entries, each of which has a first input 
sequence indicative of a first said input se- 
quence and a first occurrence likelihood field 
indicative of the number of times said first 
interpreted input se quence has been received 
since the last time said real time data collec- 
tion module emptied said buffer, and 
wherein said user data data structure prefer- 
ably further comprises a frequency table hav- 
ing frequency entries, each having a second 
input sequence field indicative of a second 
said input sequence and a second occurrence 
likelihood field indicative of the number of 
times said real time data collection buffer had 
received said second input sequence at the 
time said real time data collection module last 
emptied said buffer, and/or 

wherein said user data data structure prefer- 
ably further comprises a prediction table of 
prediction blocks, wherein each of said predic- 
tion blocks: 

(1) is indexed by a common said preceding 
sequence; and 

(2) comprises said subsequent options ar- 
ranged in descending order according to 
second occurrence likelihood fields of fre- 
quency entries having said common pre- 
ceding sequence as said preceding se- 
quence of said second input sequence 
fields. 

12. The apparatus of claim 11, wherein said user 
data data structure further comprises frequen- 
cy to prediction batch processing means for 



updating said prediction table with data in said 
frequency table by: 

(i) reading, from said frequency table, block 
frequency entries, each having said com- 

5 mon preceding sequence as said preceding 

sequence of said second input sequence 
fields; 

(ii) arranging said block frequency entries in 
descending order by said second occur- 

io rence likelihood fields; 

(iii) writing said subsequent options of said 
second input sequence fields of said block 
frequency entries to said prediction block; 

(iv) determining additional subsequent op- 
75 tions not written to said prediction block; 

(v) arranging said additional subsequent op- 
tions in a sorted order; and 

(vi) writing said additional subsequent op- 
tions to said prediction block. 

20 

13. The apparatus of any one of claims 8 to 12, 
wherein said real time data collection module 
further comprises scaling means for scaling 
the values of said second occurrence likeli- 

25 hood fields. 

14. The apparatus of any one of claims 8 to 13, 
wherein said prediction table is associated with 
a software application, 

30 or wherein said user data data structure further 

comprises additional prediction tables having 
prediction blocks indexed by said preceding 
sequences which are of varying lengths. 

35 15. The apparatus of any one of claims 8 to 14, 
wherein said template comprises said stroke 
space region and a plurality of said predicted 
option regions for a plurality of predicted op- 
tions, 

40 or wherein said template comprises said stroke 

space region, predicted option regions for a 
plurality of predicted options, a space region 
associated with the option of selecting a space 
character, a delete region associated with the 

45 deletion of the last option selected, and a 

refresh region associated with the option of 
refreshing said predicted option regions, 
or wherein the template has a sufficient num- 
ber of said predicted option regions to main- 

50 tain a high probability of having said predicted 

option region associated with the option the 
user will next desire. 

16. The apparatus of any one of claims 8 to 15, 
55 further comprising a windowing system which: 

(i) receives said description of said template 
from said stroke board display system; 
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(ii) converts said description to a screen 
presentation; and 

(iii) communicates said screen presentation 
to said display. 
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